Rational Decision-Making In Resource-Bounded Agents1
نویسنده
چکیده
The objective of this paper is to construct an implementable theory of rational decision-making for cognitive agents subject to realistic resource constraints. It is argued that decision-making should select actions indirectly by selecting plans that prescribe them. It is also argued that although expected values provide the tool for evaluating plans, plans cannot be compared straightforwardly in terms of their expected values, and the objective of a realistic agent cannot be to find optimal plans. The theory of Locally Global planning is proposed as a realistic alternative to standard "maximizing" theories of rational decision-making. 1. Rational Cognition Rational agents think about the world, evaluate various aspects of it, reflect upon how they might make it more to their liking, and act accordingly. Then the cycle repeats. This is the doxastic-conative loop, diagrammed in figure one. The defining characteristic of cognitive agents is that they implement the doxastic-conative loop by thinking about the world and acting upon it in response to their deliberations. Both human beings and the autonomous rational agents envisaged in AI are cognitive agents in this sense. 1 This work was supported by NSF grant no. IRI-IIS-0080888.
منابع مشابه
Rational Choice Theory: A Cultural Reconsideration
Economists have heralded the formulation of the expected utility theorem as a universal method of choice under uncertainty. In their seminal paper, Stigler and Becker (Stigler & Becker, 1977) declared that “human behavior can be explained by a generalized calculus of utility-maximizing behavior” (p.76). The universality of the rational choice theory has been widely criticized by psychologists, ...
متن کاملThermodynamics as a theory of decision-making with information-processing costs
Perfectly rational decision-makers maximize expected utility, but crucially ignore the resource costs incurred when determining optimal actions. Here, we propose a thermodynamically inspired formalization of bounded rational decision-making where information processing is modelled as state changes in thermodynamic systems that can be quantified by differences in free energy. By optimizing a fre...
متن کاملInformation, Utility & Bounded Rationality
Perfectly rational decision-makers maximize expected utility, but crucially ignore the resource costs incurred when determining optimal actions. Here we employ an axiomatic framework for bounded rational decision-making based on a thermodynamic interpretation of resource costs as information costs. This leads to a variational “free utility” principle akin to thermodynamical free energy that tra...
متن کاملCongressional Foreign Policy Actors on the Two Iran Banking Sanction Laws during the Obama Administration
The United States and Iran as former allies turned into adversaries after the Islamic Revolution of 1979. Since then the United States has tried to contain Iran as a state considered to be a threat to the U.S. national security. The U.S. Congress has also acted in line with the administrations’ policies and in some cases directed the administration to take a tougher stance toward Iran. A review...
متن کاملBounded Rational Decision-Making in Changing Environments
A perfectly rational decision-maker chooses the best action with the highest utility gain from a set of possible actions. The optimality principles that describe such decision processes do not take into account the computational costs of finding the optimal action. Bounded rational decision-making addresses this problem by specifically trading off information-processing costs and expected utili...
متن کامل